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Introduction 


Ir  this  paper  we  consider  the  problem  of  comparing  the  power  of 
several  features  used  in  programming  languages.  For  example,  it  is 
intuitively  obvious  to  any  programmer  that  recursion  cannot,  in  general, 
be  replaced  by  iteration  with  variables  alone,  but  recursion  can  always 
be  replaced  by  a  pushdown  stack.  This  indicates  that  a  pushdown  stack 
is  at  least  as  powerful  as  recursion,  and  that  recursion  is  more  powerful 
than  iteration.  Thus,  from  the  iteration-vs -recursion  standpoint  we 
would  say  that  ALGOL  and  PL/l  are  more  powerful  than  FORTRAN.  The 
question  is  whether  an  intuitive  notion  of  this  kind  can  be  understood 
in  a  formal  way,  and  possibly  elaborated  upon  to  obtain  a  better  \mder- 
standing  of  programming  features  and  to  enable  us  to  compare  their  power. 

Unfortunately,  the  problem  is  not  so  simple.  Consider,  for  example, 
the  programming  language  of  flowcharts,  which  contain  ideal  integer 
variables,  i.e.,  their  values  can  be  arbitrarily  large.  The  operations 
allowed  in  the  flowchart  are  incrementing  and  decrementing  variables  by 
one,  and  testing  to  see  if  the  value  of  a  variable  is  zero.  Such  a 
simple  language  with  just  three  variables  can  calculate  all  the  "computable" 
functions,  that  is,  all  the  partial  recursive  functions  over  the  natural 
numbers .  Thus  if  we  add  recursion  or  a  pushdown  stack  to  such  a  language, 
the  power  of  the  language  will  not  be  increased. 

This  suggests  that  in  order  to  carry  out  such  a  study,  we  must 

isolate  in  some  way  the  effect  of  the  programming  features,  whose  power 

\ 

we  wish  to  compare',  from  the  values  being  computed  by  the  program.  For 
this  purpose  we  consider  for  each  programming  language  a  class  of  program 
schemas ;  a  program  schema  may  use  the  control  features  of  the  language 
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but  the  basic  operations  (constants,  functions,  and  predicates)  are 
used  only  as  symbols  without  being  specified. 

Related  work  has  been  done  previously,  among  others,  by  Paterson  and 
Hewitt  (1970],  Garland  and  Luckham  [I97I],  Constable  and  Gries  [1972], 
Plaisted  [1972]  and  Chandra  and  Manna  [1972].  The  classes  of  schemas 
considered  in  these  papers  are  not  identical  to  ours,  but  the  differences 
are  not  significant.  Details  of  the  results  presented  in  this  paper 
can  be  found  in  Chandra's  thesis  [1973]. 

Part  I .  The  Class  of  Program  Schemas 

A  program  schema  is  a  program  in  which  the  data  domain  is  not 
specified.  In  addition,  the  constants  are  indicated  simply  by  the 
symbols  a^, a^, ...  ,  the  functions  by  f^,  f^, . . .  ,  and  the  predicates 
by  * ‘  •  Thus  a  Program  schema  may  be  thought  of  as  representing 

a  family  of  real  programs .  A  real  program  of  the  family  is  obtained  by 
providing  an  interpretation  for  the  symbols  of  the  program  schema,  i.e., 
specifying  a  data  domain  and  specifying  data  elements,  functions  and 
predicates  over  the  domain  for  the  symbols  a_^  ,  f^  and  p^  ,  respectively. 

In  our  program  schemas  we  use  two  kinds  of  variables:  data 
variables,  denoted  by  y^,y^, ...  ,  and  boolean  variables,  denoted  by 
zl’z2>  "•  ’  Boolean  variables  can  have  value  either  true  or  false . 

Data  variables,  on  the  other  hand,  have  values  from  the  data  domain 
that  is  specified  along  with  an  interpretation  for  the  schema.  Corres¬ 
pondingly,  we  distinguish  between  two  types  of  terms:  data  terms  and 
boolean  terms.  A  data  term  t  can  be  built  up  using  the  data  variables 


y^  of  the  schema  and  the  individual  constants  a_^  ,  and  applying  the 


function  symbols  f.  to  them.  The  value  of  a  data  term  for  a  given 

interpretation  is  always  a  data  element.  A  boolean  term  a  is  an 

atomic  formula  or  a  negated  atomic  formula,  where  an  atomic  formula 

is  a  boolean  value  (true  or  false),  a  boolean  variable  z.  ,  or  a 

predicate  test  of  the  form  T  \  TI  i 

Pv^i,  ...,Tk;  .  Under  any  interpretation, 

the  value  of  a  is  a  boolean  value,  true  or  false  . 


Simple  Algol-like  Schemas 

The  first  class  of  schemas  we  consider  is  the  class  of  Algol-like 
schemas  which  can  be  constructed  from  statements  of  the  following  form 
(we  use  standard  Algol-like  notations): 


(i) 

start  statement 

START (a) 

(ii) 

halt  statement 

HALT(t) 

(iii) 

loop  statement 

LOOP 

(iv) 

assignment  statements  y.  <-  x 

or  z.  *-  a, 
i 

(v) 

test  statement 

if  &  then  goto  else  goto  L 

L-j-  and  L2 

here  are  labels. 

In  addition  we  may  use  begin  . . .  end 

for  grouping 

statements . 

k 


The  start  statement,  START (a)  ,  Initializes  all  data  variables  y. 
to  the  value  a  and  all  boolean  variables  to  true  .  The  halt  statement, 
IIALT(t)  ,  outputs  the  data  value  of  the  term  t  .  The  loop  statement, 

LOOP  y  causer  the  schema  to  Poop  rerever . 

We  use  C-0  to  denote  the  class  of  all  simple  Algol-like  schemas. 

2-  Augmented  Algol-like  Schemas 

We  will  also  consider  Algol-like  schemas  augmented  with  features 
designed  to  make  the  schemas  more  powerful. 

(a)  Counters 

A  ou^tei  is  a  variable  whose  value  is  always  a  non-negative  integer. 
Counters  are  denoted  by  c^c^,  ...  .  All  counters  used  by  a  schema  are 
initialized  to  zero  by  the  start  statement.  The  statements  allowed 
on  an  arbitrary  counter  c  are: 

(1)  c  -  c+1 

(2)  if  c  =  0  then  goto  else  begin  c  *-  c-lj  goto  end. 

Vie  use  C-(c)  to  denote  the  clas.  of  Algol-like  schemas  with 
counters  ^it  includes  the  subclass  of  schemas  with  no  counters), 

-3(lc)  to  denote  the  class  of  schemas  with  at  most  1  counter,  and 
d(2c;  to  denote  the  class  with  at  most  2  counters. 

(b)  Pushdown  Stack 

A  pushdown  stack  is  a  last-in  first-out  store  in  which  a  pair  of 
values  of  both  types  (data,  boolean)  can  be  stacked.  Pushdown  stacks 
are  denoted  by  sp, sp, •••  •  All  pushdown  stacks  used  by  a  schema  are 
initialized  to  be  empty  by  the  staru  statement.  A  schema  with  a  stack 
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can  "push"  a  data  value  and  a  boolean  value  into  the  stack,  and  it 
can  "pop"  them  (if  the  stack  is  non-empty). 

The  statements  allowed  on  an  arbitrary  pushdown  stack  s  are: 

(1)  push(s,y,z) 

(2)  if  s  =  A  then  goto  1^ 

else  begin  pop(s,y,z);  goto  end  . 

Here,  y  denotes  an  arbitrary  data  variable,  z  a  boolean  variable, 
and  A  the  empty  stack.  The  statement  "  £us_h(s,y,z)  «  adds  the  current 
values  of  the  variables  y,z  on  top  of  the  stack  s  .  The  statement 
"  £2£(s>y>z)  "  does  the  opposite:  the  one  data  and  one  boolean  value 
at  the  top  of  the  stack  s  are  assigned  to  the  variables  y  and  z  , 
respectively,  and  these  two  values  are  removed  (popped)  from  the  stack. 

We  use  ^(s)  to  denote  the  class  of  Algol-like  schemas  with 
pushdown  stacks,  and  similarly  for  C-(ls)  and  <3(2s) 

(c)  Queues 

A  queue  is  a  first-in  first-out  store.  Queues  are  denoted  by 
W'"  •  A11  queues  used  by  a  schema  are  initialized  to  be  empty 

by  the  start  statement .  A  schema  with  a  queue  can  "add"  values  at  one 

end,  and  "remove"  them  from  the  other.  The  statements  allowed  on  an 
arbitrary  queue  q  are: 

(1)  add(q,y,z) 

.  . 

vw  if  q  =  A  then  goto 

else  begin  remove (q,y,z) ;  goto  L2  end.  . 

The  statement  "  add(q,y,z)  "  adds  the  current  values  of  the  variables 

] 

Y,z  at  one  end  of  the  queue.  The  statement  "  remove(q ,y, z)  "  does  the 
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following:  the  one  data  and  one  boolean  value  at  the  end  of  the  queue 
are  assigned  to  the  variables  y  and  z  ,  respectively,  and  these  two 
values  are  removed  from  the  queue. 

We  use  q)  to  denote  the  class  of  Algol-like  schemas  with  queues, 
(d)  Arrays 

An  array  is  a  semi-infinite  sequence  of  "locations"  (numbered 
0,1,2,...  ),  each  of  whicn  can  take  on  a  pair  of  values:  one  data  value 
and  one  boolean  value.  Arrays  are  denoted  by  A  ,A^, ...  .  The  start 
statement,  START (a)  ,  initializes  all  locations  in  arrays  to  the  data 
value  a  and  the  boolean  value  true  .  A  location  can  be  accessed  by 
subscripting  the  array  with  a  counter.  The  statements  allowed  on  an 
arbitrary  array  A  are: 

(1)  A[c]  -  (y, z) 

(2)  (y,z)  A[ c  ]  . 

We  use  (3(A)  to  denote  the  class  of  schemas  with  arrays.  Note 
that  the  use  of  an  array  implies  the  use  of  counters,  that  is,  schemas 
in  (3(A)  do  have  an  arbitrary  number  of  counters . 

The  class  of  Algol-like  schemas  with  any  or  all  these  features 
(counters,  stacks,  queues,  arrays)  is  denoted  by  <3(s,q,A)  . 


3.  Recursive  Schemas 

A  recursive  schema  consists  of  a  set  of  recursive  definitions  of 
the  following  form: 


F^(a,a, . . ., true, true, . . . )  where 

Fl(^l’Zl)  <=  “l^l'V^  then  T1(y1,z1,F)  else  t^z^f) 

Fn<V5n>  <=  an(V  VF)  ^  Tn(V  Vf)  *A(V  V?)  > 
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where  y.  represents  a  vector  of  data  variables,  5  a  vector  of  boolean 
variables,  and  F  ==  (l1^,  . . . ,  I1^)  is  a  vector  of  "defined  Junctions". 

Lach  defined  function  l‘\  may  take  both  data  values  and  boolean  values 
as  arguments  but,  for  simplicity,  we  assume  that  it  always  returns  just 
one  data  value.  ^(y^>z^,F)  is  a  boolean  term  and  T.(y.,z.,F)  and 

Ti^yi’Zi,F)  are  data  terms  that  may  use  the  variables  in  yi  and  z.  ,  and 
the  defined  functions  F  along  with  the  constant  symbols  a^a  ,  ...  ,  the 
function  symbols  ,  and  the  predicate  symbols  p  ,p  ,  ...  . 

The  value  of  the  schema  for  any  given  interpretation  is  the  value 


oi  F^  with  all  its  data  arguments  set  to  the  value  of  the  individual 
constant  a  ,  and  all  its  boolean  arguments  set  to  true.  During 
computation,  all  arguments  are  passed  by  value,  i.e.,  the  innermost 
function  calls  are  evaluated  first.  Note  that  there  are  no  "global" 
variables,  and  function  calls  cannot  have  any  side  effects,  they  simply 
return  values. 

Wo  use  £(R)  to  denote  the  class  of  all  recursive  schemas. 


t  •  Equality 

We  also  consider  schemas  in  which  every  boolean  term  ot  may  have 
the  form  =  tg  or  j  in  addition  to  the  earlier  possibilities. 

When  equality  is  allowed  in  a  class  £(•••)  ,  we  denote  the 
augmented  class  by  (3(  •  •>,=)  •  Thus,  we  use  (3(=)  to  denote  the  class 
of  Algol-like  schemas  with  equality,  Ci(c,=)  to  denote  the  class  of 
Algol-like  schemas  with  counters  and  equality,  C-( F,  =)  to  denote  the 
class  of  recursive  schemas  with  equality,  etc . 
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5-  Example 


Any  two  schemas  S  and  S’  are  said  to  be  equivalent  if  for  every 

*/ 

interpretation  of  S  and  O'  either  both  schemas  diverge  (i.e., 
loop  forever) ,  or  both  halt  with  the  same  output . 

Consider  the  following  recursive  schema 
S0:  F(a)  where 

F(y)  <=  if  p(y)  then  y  else  f(y,F(g(y) ) )  . 

Note  that  if  we  have  an  interpretation  of  for  which 

P(sn(a))  =  true  for  some  n  >  0  ,  and 
p(g1(a))  =  false  for  all  i  <  n  , 

then 

F(a)  =  f(a,f(g(a), f(g2(a), . .  .,f(gn_1(u),gn(a)) . . .)))  • 

Below  we  exhibit  some  Algol-like  schemas  that  me  equivalent  to  5()  . 
To  simplify  the  programs  wa  use  an  extended  Algol-like  language,  using 
regular  while  . . .  do  . . .  statements,  goto  statements  and  if  •  •  •  then  . . . 
statements.  All  these  statements  can  be  expressed  easily  in  terms  of 
our  primitive  statements.  We  allow  also  the  statement  c^  -  which 
can  be  replaced  by  iegal  statements  for  counters  by  udding  one  additional 
counter. 

For  clarity,  we  add  a  few  comments  in  the  schemas  below.  Since 
boolean  variables  play  no  role  ir  this  example,  we  ignore  their  presence 
in  the  comments . 


i.e.,  the  interpretation  includes  an  assignment  to  all  constant, 
function  and  predicate  symbols  occurring  in  S  or  in  o'  . 
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^a)  A  simple  schema 


G.  :  CTABT(a); 

while  -»  v&i)  yx  -  ^(y1) ; 

(comment :  y  =gn(a)} 

L:  i£  P(yj+)  then  HALT(yn) 

else  begin  y2  -  a;  y^  -  g(yJ+) ;  y^  -  yj+  end; 
[comment:  in  the  i-th  loop  (1  <  i  <  n) 

y2  =  n°(a),  y,,  =  g1(a),  yJ(  =  gi(a)} 
while  -i  P(yp  do  begin  y2  -  g(y2)  ;  y,  -  g(y  )  end; 
{comment:  in  the  i-fch  loop  (1  <  i  <  n) 

y2  =  Gn_1(a),  y^  =  gn(a),  yJ(  =■-  gx(a)} 

yi  *"  f(y2^i); 
goto  L  . 

(b)  A  schema  with  counters 
Sg:  START (a); 

whi.]e  "»  P^)  do  begin  -  g^) ;  Cl  -  c^+1  end; 
[comment:  ;/1  =  gn(a),  c  -  n} 

L:  if  c±  =  0  then  UALT(y) 

else  begin  y2  -  a;  c.,  -  Cj-1;  c;)  -  c  end; 
while  c2  /  0  do  begin  yg  -  g(y2) ;  cg  -  c  -1  end; 
[comment:  in  the  i-th  loop  (1  <  i  <  n) 
y2  =  8n’i(a),  c1  =  n-i} 

yi  *"  f(y2,yi)  5 
goto  L  . 
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(c)  A  schema  with  a  pushdown  stack 


K,,:  START  (a)  ; 

while  -np(yi)  do  beiun  £u£h(c,yi,./,);  y^  _  g^)  end; 
[comment:  y1=Cn(a),  a  =  (a,,j(a), . .  .,cn_1(a)) } 

L:  if  s  =  A  then  HALT(y^)  else  pop( s,y, , z) ; 

[comment:  in  the  i-tli  loop  (1  <  i  <  n) 

y^  =  dn_1(a),  c  (a,c(a),...w:n'i’1fu))} 

yl  *"  f(-va»yi)  5 
goto  L  . 

(d)  A  schema  with  an  array 
Sjj :  START  (a); 

while  -i  P(y1)  do  begin  A[c]  -  (y^z) ;  c  -  c+1;  y;L  -  g(y  ) 
[comment:  y;L  =  gn(a),  A[0]  =  a,  A[l]  =g(a),  ... 
A[n-1]  =gn  1(a),  c  a  n] 

L:  if  c  =  0  then  1 1  ALT  (y^ 

else  begin  c  -  c-1;  (y2>z)  -  A[c]  end; 

[comment:  in  the  i-th  loop  (1  <  i  <  n) 

n-i/  .  , 

•Yp  =  S  (a),  c  n-i) 

yl  *"  f(y2’yi)  5 

goto  L  . 


end; 


(e)  A  schema  with  equality 
S^:  STAET(a); 

while  -i  P(yx)  do  y±  -  g(yi) ; 
y2  -  yx; 

[comment :  y1  =  y2  =  gn(a) } 

L:  1£  y2  =  a  thGn  HALT(y1)  else  y^  -  a; 

^il.e  8(y3)  /-  y2  do  y,  -  g(y3) ; 

y2  -  y3; 

[comment:  in  the  i-th  loop  (1  <  i  <  n) 

n-i,  n 

y2  =  y3  =  s  (a)) 

yi  *“  f(y2,yi); 

goto  L 


Part  II.  On  the  Power  of  Classes  of  Schemas 

Let  ^  and  Q,  be  two  classes  of  schemas.  We  say  that 

(a)  C-,  is  more  powerful  than  (notation:  <3^  >  Cg)  if  for  every 

schema  in  there  is  an  equivalent  schema  in  (2^  , 

(b)  and  are  equally  powerful  (notation:  =  C,  )  if 

>  C2  and  C-g  >  ,  and 

(c)  ^  is  strictly  more  powerful  than  C.  (notation:  >  Cg)  , 

if  >  C-2  but  ^  Cg  . 

1.  The  Comparison  Diagram 

We  now  consider  tne  interrelations  between  the  classes  of  schemas 
we  have  defined. 
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Intuitively,  anything  that  can  be  clone  iteratively  can  also  be 
done  recursively  .  In  other  words,  we  would  expect  that  d(R)  >C,()  ,  and 
<3(R,  =)  >(!(=)  .  That  these  are  indeed  true  was  shown  by  McCarthy  [1962]. 

Also,  as  mentioned  earlier,  one  expects  that  recursion  is  strictly  more 
powerful  than  iteration.  Paterson  and  Hewitt  [I97O]  showed  that  there 
are  certain  recursive  schemas  for  which  there  are  no  equivalent  simple 
Algol-like  schemas,  i.e.,  cl(R)  >d()  ,  and  also  <3(R,=)  >*!(=)  • 

Another  intuitive  notion  is  that  recursion  can  always  be  replaced 
by  a  pushdown  stack.  Thus,  if  our  schemas  in  o(R)  and  <3(ls)  do 
capture  the  intuitive  power  of  recursion  and  of  a  pushdown  stack,  we 
would  expect  that  d(R)  <o(ls)  ,  and  similarly,  ii(R, -)  <<l(ls,  )  .  These 
were  shown  to  be  true  by  Hewitt  [  1970  |  and  by  Constable  and  Gries  f  1972].  One 
should  also  ask  whether  a  pushdown  stack  has  power  strictly  greater  than 
recursion,  or  whether  they  are  equally  powerful.  To  state  this  in 
another  way,  we  observe  that  recursion  involves  the  use  of  an  implicit 
stacking  mechanism.  The  question  is  whether  or  not  this  implicit  stack 


really  utilizes  the  full  power  of  a  pushdown  stack.  Chandra  [1975] 
answered  this  by  showing  that  C-(R)  ^  <3(ls)  ,  and  that  <3(p,=)  =<3(ls,=)  ^ 
Paterson  |  unpublished  memorandum]  and  Garland  and  Luckham  [I'T/l]  showed 
that  (1(c)  >  C(le)  .  Plait; ted  1 1')72  I  proved  the  surprising  result  that  the 
addition  of  just  one  counter  to  simple  Algol-like  schemas  adds  no  power, 
i.e.,  C(lc)  =  d( )  .  However,  the  addition  of  a  second  counter  adds 
power,  i.e.,  d(2c)  >  <3(lc)  ;  and  after  that,  the  addition  of  a  third, 


fourth,  fifth  counter,  etc.,  does  not  increase  the  power. 


It  can  be  shown  that  the  power  of  recursive  schemas  is  not  affected 


by  the  addition  of  features  such  as:  (a)  recursive  definitions 
which  consist  of  simple  Algol- like  programs  with  global  variables 


and  local  variables  as  well  as  recursive  calls,  or  (b)  defined 
functions  which  return  not  just  one  data  value,  but  a  vector  of  data 
and  boolean  values . 
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Constable  and  Gries  [1972]  introduced  schemas  with  arrays  and 
used  a  problem  suggested  by  Paterson  and  Hewitt  to  show  that  G( A)  >  £(r) 
Chandra  and  Manna  [1972]  observed  that  the  use  of  equality  increases  the 
power  of  schemas . 

The  interrelationships  between  the  various  classes  of  schemas  is 
shown  in  Figure  1.  In  the  figure  (and  all  following  figures),  if  there 
is  an  ascending  arc  (or  a  chain  of  such  arcs)  leading  from  a  class  <3^ 
to  a  class  >  aritt  Gg  is  above  <3^  in  the  figure,  it  means  that 
"  C2  is  a  strictly  more  powerful  class  than  "  .  If  two  classes, 
i3j  and  G;1  >  are  not  linked  by  an  ascending  chain  of  arcs,  then  the 
classes  arc  unrelated,  i.u.,  G,  £  G,,  and  a,  £  .  For  example, 

G(=)  £  (3(A)  ,  and  Q,( A)  ^G(=)  •  In  other  words,  there  is  at  least 
one  schema  in  G(=)  for  which  there  is  no  equivalent  schema  in  G(A)  , 
and  vice  versa.  Details  of  all  the  results  suggested  by  Figure  1  can 
be  found  in  Chandra's  thesis  [1973]. 

From  Figure  1  it  is  apparent  that  schemas  with  arrays  and  equality 
act  as  a  "maximal"  class.  In  fact,  any  arbitrary  schema  with 
equality,  counters,  stacks,  queues  and  arrays  can  be  effectively 
translated  into  an  equivalent  schema  with  equality  and  one.*  array. 

Also,  one  pushdown  stuck  has  the  same  power  as  recursion,  but  two  stacks 
are  strictly  more  powerful  --  they  are  together  as  powerful  as  arrays. 
Even  the  seemingly  "weaker"  class  with  one  pushdown  stack  and  one  counter 
has  the  same  power  as  arrays.  Observe  that  a  queue  is  a  more  powerful 
feature  than  a  stack;  actually,  a  queue  is  as  powerful,  as  two  stacks 
(addition  of  more  stacks  or  queues  adds  no  power) . 
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Li  it.  interesting  to  label.  the  vertices  ol‘  l*':i .)  in  another  way, 
as  shown  in  Figure  2.  (Note  that  Figures  .1  and  2  are  isomorphic;  that 
is,  they  represent  the  same  relationships).  This  figure  can  be  treated 
as  a  unit  cube  where  the  axes  are  labeled: 

x-axis :  add  a  stack  and  delete  *.  counter", 

y-axis:  "add  a  counter",  and 
z-axis:  "add  equality  tests". 


Figure  2 


2 .  Some  Proofs 

To  illustrate  how  the  results  of  Figure  1  are  proved,  we  give  an 
intuitive  idea  of  the  proofs  for  the  results  indicated  in  Figure  ;/. 


H 


cl) 

Figure  3 

In  the  following  we  use  the  result  that  for  any  classes  Q,  ,  30  , 

C-  of  schemas,  if_  (^  <  C2  £  3^  and  <  Cj  then  <2^  <  Cj  .  This 
follows  from  the  fact  that  if  C1<C2't.Cz)  "then  there  is  a  schema  S 
in  3^  for  which  there  is  no  equivalent  schema  in  Q,  ,  and  hence  no 

.  Since  <(J,  , 
it  follows  that  3-^  <  3,  •  Similarly  we  have  that  if  3^  >  32 
and  3^  3  3-  then  3^  >  3,  .  Thus,  to  show  that  3(A)  >  3(R)  >  3()  , 
3(A)  >  3(c)  >  Cl)  ,  and  that  3(R)  and  3(c)  are  unrelated,  it  suffices 
to  prove  that  3(A)  >3(R)  >3()  ,  3(A)  >  3(c)  >3()  ,  and  that  3(R) 
and  3(c)  are  unrelated,  i.e.,  3(R)  ^3(c)  and  3(R)  £  3(c)  •  This 

follows  because 

C{)  <  3(c)  £C(R)  and  3()  <  3(R)  imply  3()  <  3(R)  , 

3()  <  3(R)  £  3(c)  and  3()  <  3(c)  imply  3()  <  3(c)  , 

3(A)  >  3(c)  ^3(R)  and  3(R)  <  3(A)  imply  3(R)  <  3(A)  ,  and 

3(A)  >3(R)  ^  3(c)  and  3(c)  <  3(A)  imply  3(c)  <  3(A)  . 

It  is  trivial  that  3(A)  >  3(c)  _>3()  since  every  schema  in  3() 
is  in  3(c)  ,  and  every  schema  in  3(c)  is  in  3(A)  .  We  also  have 


equivalent  schema  in  .  This  implies  that  3.  £  3^ 
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o(R)  >  <3()  since  every  simple  Algol-like  schema  can  be  translated, 
into  an  equivalent  recursive  schema  by  associating  a  defined  function 
with  each  statement  in  the  Algol-like  schema.  £(A)  >  C-(R)  can  be 
shown  by  simulating  a  pushdown  stack  with  arrays  using  standard 

call-by-value  ALGOL  compilation  (booleans  are  used  to  represent  the 
return  address) . 

The  interesting  part  is  to  shov:  that  C-(R)  and  <3(c)  are 
unrelated,  1 . e . ,  to  exhibit  a  schema  S1  in  C-(R)  for  which  there 
is  no  equivalent  schema  in  C.(c)  ,  and  a  schema  in  C(c)  for 

which  there  is  no  equivalent  schema  in  C-(R)  . 

(a)  Consider  the  following  recursive  schema  (in  (3(R)  ): 

F(a)  where 

F(y)  <=  if  p(y)  then  y  else  l'(F(g(y)),F(h(y) ) )  . 

There  is  no  schema  in  C-(c)  equivalent  to  this.  The  reason  is  that 
the  computation  requires  storing  an  arbitrarily  large  number  of 
temporary  data  values,  whereas  every  schema  in  C,(c)  has  a  fixed 
number  of  data  variables. 

Consider  a  class  of  interpretations  {ln}  having  the  foLlowing 
property:  for  every  I  ,  n  >  0  , 

(i)  distinct  terms  yield  distinct  data  elements  under  I  ,  and 

n 

(ii)  p  is  true  only  for  the  terms  that  contain  n  occurrences 
of  the  functions  g  and  h  applied  to  a  . 

The  schema  S±  on  the  interpretation  ln  computes  the  term  t  (a)  where 
T0(y)  =  y  ,  and 
T>i(y)  =  f(Ti(e(y)),T.(h(y)))  • 
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Kor  example,  S1  under  I1  and  lg  computes  the  teims  f(g(a),h(a)) 
f(g(s(a) )  >h(g(a) ) ) ,  f(g(h(a)  ),h(h(a) )) )  ,  respectively.  These 
terms  can  also  be  represented  as  binary  trees  as  shown  below: 

T1(a)  :  i'(g(a),h(a))  is 


G(a)  h(a) 


T2(a)  :  f(f(g(g(a)),h(g(a))),f(g(h(a)),h(h(a))))  is 


Suppose  there  is  a  schema  S  from  £(c)  that  is  equivalent  to  S  . 

Without  loss  of  generality  we  assume  that  S  has  no  symbols  other  than 

a  ,  f  ,  g  ,  h  and  p  ,  that  the  only  assignments  that  use  f  have  the 

form  y_.  -  l(y^,y^)  ,  and  that  halt  statements  have  the  form  HALT(y.)  . 

•  onsider  the  computation  of  S  under  the  interpretation  ]  .  Since  S 

n 

is  assumed  to  be  equivalent  to  S^  it  computes  the  term  t  (a)  which 
can  be  represented  as  a  perfectly  balanced  binary  tree  of  height  ri  . 

Now  we  consider  the  computation  of  arbitrary  binary  trees  in  which  each 
node  corresponds  to  a  distinct  value  and  where  in  a  single  step  at  most 
one  binary  function  can  be  applied.  It  is  well  known,  and  can  be  proved 
readily  by  induction,  that  the  number  of  variables  #(T)  required  to 
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compute  the  term  corresponding  to  such  a  binary  tree  T  is  given  by 
#(  c )  =  1  >  and 

=  if  (#(1^)  =#(Ta))  then  #(1^+1 

else  raax(#(T1),#(Tg))  • 

This  tells  us  that  n+1  variables  are  required  for  computing  the  term 
T  (a)  .  For  example,  three  variables  are  required  to  compute  t 2(a)  : 

y1  -  g(s(a) )  ;  y2  -  h(g(a) )  ;  -  fCy^y^  ; 

y2  -  g(h(a))  ;  y3-h(h(a))  ;  y2  -  f(y2,y5)  ; 

yi  *"  ’ 

Now,  if  the  schema  S  has,  say,  m  data  variables,  then  for  the 
computation  of  Tm  under  ,  S  must  have  at  least  m+1  data 
variables  —  a  contradiction.  Tims  no  schema  in  3(c)  is  equivalent 
to  • 

(b)  Consider  the  following  problem:  "given  a  constant  a  ,  unary 
functions  f, g  ,  and  a  predicate  p  ,  find  an  element  x  of  the  form 
f1(gJ(a))  ,  i, j  >  0  ,  such  that  p(x)  is  false.  If  no  such  x  exists 
then  the  schema  loops  forever" .  In  the  following  we  refer  to  this 
problem  as  the  witch-hunt  problem. 

It  is  easy  to  see  that  schemas  in  <3(c)  can  solve  this  problem. 

The  following  is  one  such  schema: 
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START (a) ; 


L,  :  cr 


a: 


L2:  °3  c2;  y2  ~  yi; 

while  /  0  do  begin  c.  -  c^-1;  yg  -  f(y2)  end; 
if  -i  p(y2)  then  HALT(y2)  ; 

yl  *"  g^yl^  ’ 

if  c2  j=  0  then  begin  cg  *-  cg-l;  goto  LQ  end; 

C1  -  c  +1; 
goto  Ll  • 

The  idea  is  that  for  a  given  ,  c^  =  0, 1,2,3, ••• (l, -loop)  ,  v/o 
check  the  value  of  p  for  all  possible  terms  of  the  form 
co  C1_C2 

y2  =  f  (g  ‘"(a))  in  the  following  order:  cg  =  c^c^l,  . .  .,l,0(L?-loop)  . 

However,  no  schema  in  <3( R)  can  solve  the  witch-hunt  problem. 

Intuitively,  the  reason  is  that  no  schema  in  C,( R)  can  compute  all 

terms  of  the  form  f1(g'^(a))  ,  in  any  order.  For  suppose  there  is  a 

schema  S  in  (3(R)  that  solves  the  witch-hunt  problem.  Then,  without 

loss  of  generality  we  can  assume  that  S  he--',  no  predicate  other  than  p  , 

and  that  defined  functions  in  S  have  no  boolean  arguments.  Let  n 

be  the  largest  number  of  arguments  of  any  defined  function  in  S. 

Consider  an  interpretation  1^^  for  which  the  predicate  p  is  true 

for  all  terras.  We  also  require  that  distinct  terms  yield  distinct  data 

elements  under  1^.  >  an<i  we  claim  that  S  cannot  generate  all  the 

terms  on  the  n+1  columns  described  in  Figure  . 

The  .j-th  column,  0  <  j  <  n  ,  consists  of  all  terms  f1(gJ(a))  for 

all  i  >  0  .  To  show  this,  we  divide  all  terms  into  2n+3  sets  A.  ,  B.  ,  C 

J  J 
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Fij^ure  4 

for  0  <  j  <  n  .  The  set  A  consists  of  the  single  terra  gJ'(a)  , 
the  set  B_.  consists  of  the  entire  column  of  terms  fi(g'^(a)) 
for  i  >  0  ,  and  the  set  C  is  the  "catch  all"  consisting 
of  all  other  terms.  Now,  as  the  schema  S  must  loop  on  the  interpreta¬ 
tion  I^rue  *  and  there  are  only  finitely  many  sets,  there  must  he  some 
defined  function  that  calls  itself  recursively  such  that  each  one 
of  its  argmments  is  in  the  same  set  as  in  the  earlier  call.  Then,  as 
the  predicate  tests  are  always  true,  the  defined  functions  called 
between  such  two  calls  of  F^  are  repeated  in  the  same  order,  and  with 
the  arguments  from  the  same  sets  as  before.  Hence,  there  is  at  least 
one  coiumn,  say  j  ,  such  that  no  argument  of  these  calls  of  F.  is 
from  it.  Therefore  only  finitely  many  terms  from  column  j  can  be 
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reached  during  the  computation,  i.e.,  there  is  at  least  one  term,  say 


f  '''(g  ^(a))  ,  that  is  never  tested. 

Now  we  chfrtge  the  interpretation  1^  slightly  to  ^not  •'o  true 

^1  ^1 

in  which  p  applied  to  all  terms  is  true  except  that  p(f  (g  (a))) 


is  false.  Then  the  computation  f  S  on  the  interpretation  I 


not  sc  true 


is  the  same  as  the  computation  '  r  1^^^  »  i-e.,  G  will  loop  on 


not  so  true 


But  as  G  is  assumed  to  solve  the  witch-hunt  problem, 


1  *1 

it  must  halt  with  output  f  (g  (a))  —  a  contradiction.  This  proves 
that  no  schema  in  c/R)  can  solve  the  witch-hunt  problem. 

It  is  interesting  to  r.ute,  however,  that  the  witch-hunt  problem 
can  indeed  by  solved  by  some  Algol-like  schemas  with  equality  and  no 
counters,  i.e.,  by  schemas  in  fl(=)  (see  Chandra  [1973])- 


3.  Number  of  Variables  and  Depth  of  Data  Terms 

One  can  investigate  further  the  effect  of  the  number  of  data 

variables  on  the  power  of  schemas .  It  can  be  shown,  for  example,  that 

*/ 

for  every  n  ,  n  >  0 

(a)  3( R,  n  var)  >  3(n  var) 

(b)  C^R,  1  var)  ^  3(n  var) 

(c)  3( u  var)  £  3(n+l  var) 

This  implies  the  relations  shovai  ir.  figure  5*  Recall  that  if  there  is 
an  ascending  arc  leading  from  any  class  3^  to  another  class  30 
it  moans  that  3^.<  3g  • 


Here,  "  n  var  "  indicates  that  the  schema  has  at  most  n  data 
variables  (in  Algol- like  schemas)  or  at  most  n  data  arguments 
for  defined  functions  (in  recursive  schemas). 
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Simple  Algol-like 
(no.  of  variables) 


Recursive 

(no.  of  variables) 


Figure  5 


(a)  The  result  that  <3,(R,  n  var)  >  £( n  var)  follows  by  the  standard 
process  of  translating  a  simple  Algol-like  schema  into  an  equivalent 
recursive  schema.  (b)  The  recursive  schema  above  is  in 

C-(R,  1  var)  ,  but  there  is  no  schema  in  (\{ n  var)  ,  for  any  n  >  0  , 
which  is  equivalent  to  .  (o)  lo  show  that  there  is  a  schema  in 

<3(n+l  var)  which  is  not  equivalent  to  any  schema  in  <3(R,  n  var)  we 
consider  the  following  problem. 

"Find  an  element  x  of  the  form  f^g^x))  ,  i  >  0  and  j  <  n  , 
such  that  p(x)  is  false."  We  refer  to  this  problem  as  the  restricted 
witch-hunt  problem.  The  following  schema  in  C^n+1  var)  solves  the 

problem. 


2h 


S,:  START (a) ; 

*2  ^y  1^  ’  *”  >  •  •  •  s  ^n+i  *“  e(yn)  5 

L:  if  -,  p(yi)  then  HALT^)  else  ^  -  ffy^ ; 

if  —i  P(y2)  then  HALT(y2)  else  yg  -  f(yy); 

—  ",p(yn+l)  —  HAM,(yn+l)  ^  yn+l  f(yn+l); 
goto  L 

Our  earlier  proof  shows,  however,  that  there  is  no  schema  in  <3( R,  n  var) 
which  solves  the  problem,  and  therefore  there  is  no  schema  in  <3(R,  n  var) 
which  is  equivalent  to  S 

") 

»  " 

There  is  no  need  to  investigate  how  the  number  of  boolean  variables 
affects. the  power  of  the  schemas,  since  it  can  be  shown  that  boolean 

variables  do  not  add  any  inherent  power  to  Algol- like  schemas  or  to 

recursive  schemas  (with  or  without  equality) ^ 

We  can  further  consider  how  the  depth  of  data  terms  affects  the 
power  of  schemas .  The  depth  |t  |  of  a  data  term  r  is  defined  as 
follows:  |ai|  =  0,  (yj  =  0  ,  and  | f .  (t^  . .  .,Tn)  |  *  1  +  max{ ItJ  ,  . .  |tn 

•X-#  / 

Trivially , — '  <3(0  var,  0  depth)  =  3(n  var,  0  depth)  <  <3(0  var,  1  depth) 
for  all  n  .  It  can  be  shown  that  for  every  n  >  0  and  d  >  0  ,  we 
have: 

(a)  <3(n  var,  d+1  depth)  £  <3(n+l  var,  1  depth)  ,  and 

(b)  <3(n+l  var,  d  depth)  £  <3(0  var,  d+1  depth)  . 


+7 .  “  ~  - - — - 

dote,  however,  that  owing  to  the  particular  way  we  introduce 

pushdown  stacks,  queues  and  arrays,  at  least  one  boolean  variable 
is  required  to  make  use  of  these  features. 


Here  "  d  depth  " 
at  most  d  . 


indicates  that  the  schemas  use  data  terms  of  depth 
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These  results  imply  the  relations  described  in  Figpre  6.  hol  e  that  the 
figure  indicates,  for  example,  that  3(3  var,  2  depth)  and 
<3(2  var,  5  depth)  are  unrelated. 

(a)  The  first  result  can  be  proved  by  using  the  restricted  witch-hunt 
problem. 

(b)  The  second  result  can  be  proved  by  observing  that  the  following 

schema  in  3(0  var,  d+1  depth)  is  not  equivalent  to  any 

schema  in  3(n+l  var,  d  depth)  : 

S,  :  START  (a); 

HAIJT(f(f^(a),f^(a),...,/+?(a)))  , 

where  f^(a)  means  f  applied  d  limes  to  the  constant  a  . 


Figure  6 


4.  Discussion 


It  is  reasonable  to  ask  what  it  is  about  the  various  features 
we  have  discussed  that  makes  one  class  of  schemas  more  powerful  than 
another.  An  observation  of  the  arguments  involved  in  proving  the 
interrelationships  shown  in  Figures  1  and  2  suggest  three  intuitive 
factors  that  determine  the  power  of  the  various  features . 

(a)  The  amount  of  data  space  (x-axis  of  Figure  2  --  "add  a  stack 
and  delete  a  counter")  .  Simple  Algol-like  schemas*  and  even  those 
with  counters  and  equality*  have  a  fixed  amount  of  data  space.  This 
limitation  is  shown  by  the  fact  that  these  schemas  just  cannot  compute 
certain  terms  which  are  too  large.  The  additions  of  a  data  variable 
to  simple  Algol-like  schemas  increases  the  power,  o.s  may  be  expected. 
Recursive  schemas  act  as  if  they  had  an  unbounded  amount  of  data  space 
available  to  them*  as  do  schemas  with  stacks,  queues  or  arrays . 

(b)  The  control  capability  (y-axis  of  Figure  2  —  "add  a  counter"). 
The  control  capability  of  a  schema  signifies  the  ability  of  the  schema 
to  decide  what  to  do  next.  Boolean  variables  and  counters  are  examples 
of  features  that  help  in  making  such  decisions.  Boolean  variables 
however  add  no  inherent  power*  while  two  counters  add  as  much  control 
power  as  one  might  want.  A  pushdown  stack  provides*  in  addition  to  an 
unlimited  amount  of  data  space*  some  control  capability  because  a  stack 
can  simulate  a  counter*  but  it  does  not  have  as  much  control  capability 
as  two  counters.  A  queue*  on  the  other  hand,  provides  in  addition  to 
unlimited  data  space*  as  much  control  capability  as  two  counters. 
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One  can  also  consider  other  programming  features  that  provide 

*/ 

control  capability.  One  such  example  is  the  boolean  stack-'  which  is  a 
pushdown  stack  consisting  entirely  of  boolean  values  (see  also  Green, 
Elspas  and  Levitt  [T/71])- 


(c)  The  structure  of  terms  (z-axis  of  Figure  2  -  "add  equality")  . 

In  our  discussion  we  observed  that  the  addition  of  terms  containing 
equality  increases  the  power  of  schemas.  This  illustrates  that  if  we 
enrich  the  structure  of  terms  allowed  we  may  increase  the  power  of 
schemas.  On  the  other  hand,  if  we  restrict  the  structure  of  terms, 
such  as  by  limiting  the  depth  of  data  terms,  we  may  decrease  the  power. 


A  boolean  stack  is  strictly  more  powerful  than  one  counter  but 
strictly  less  powerful  than  a  pushdown  stack  or  two  counters.  Two 
boolean  stacks,  however,  are  just  as  powerful  as  two  counters  (as 
is  also  one  boolean  queue)  . 
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